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EPRRI’s Research Activities into the 
Impact of Key NCLBA Requirements: 



The Educational Policy Reform 
Research Institute EPRRI, with fund- 
ing from the U.S. Department of 
Education 's Office of Special 
Education Programs , investigates the 
impact of educational accountability 
reforms on students with disabilities 
and on special education. EPRRI 
addresses the research needs of 
policy-makers and other key stake- 
holders by identifying critical gaps 
in current knowledge , seeking 
promising strategies , and publish- 
ing Topical Reviews , Policy 
Updates , and Issue Briefs. 

The Institute is a joint venture of 
the Institute for the Study of 
Exceptional Children and Youth at 
the University of Maryland, the 
National Center on Educational 
Outcomes at the University of 
Minnesota, and the Urban Special 
Education Leadership Collaborative. 



In signing the 2001 Reauthorization 
of the Elementary and Secondary 
Education Act (2001 ) known as the 
No Child Left Behind Act (NCLBA) 
President Bush placed students with 
disabilities into the center of perf o rrrr 
ance based educational reform in the 
United States. For twenty five years 
public school systems measured suc- 
cess for students with disabilities pri- 
marily on compliance with statutory 
procedures and the timely delivery of 
educational services con- 
tained in the IEP rather 



learring. Performcnce indicators must 
include student participation in and 
achievement on state assessments in 
mathematics and English language 
arts/ reacing, high school graduation 
and one other academic indicator, 
generally student attendance. Two 
additional and controversial tenets of 
this round of education reform are 
that performance on these indicators 
has timely and direct consequences to 
school systems and that these systems 
should account for the perf o rmance of 




achievement or post school outcomes. 

This most recent federal reform 
effort in education attempts to meas- 
ure school effectiveness by what really 
matters — whether or not children are 



all students and each disadvantaged 
student group. 

This Policy Update looks at some of 
EPRRI's research activities into the 
impact of key NCLBA requirements: 




• Topical Review 4: Emerging State- 
level Themes: Strengths and 
Stressors in Educational 
Accountability Reform; 

• Topical Review 5: Highly Qualified 
Teachers for Students with 
Disabilities: Identifying the 
Knowledge and Skills Needed by 
Special Educators; 

• February 2003 Policy Symposium: 
Pa rent Perspectives: Reporting the 
Perfo rrvance and Achievements of 
Students with Disabilities; 

• Issue Brief 6: Opportunities and 
Challenges: Perspectives on NCLBA 
from Special Education Directors in 
Urban School Districts; 

• Field-Based Research: How Did 
They Do? A Review of 2002-03 
Annual Yearly Progress Results in 
EPRRI's Participating Study Sites. 

Emercjng State-Level 
Themes: Strengths and 
Stressors in Educational 
Accountability Reform 

Topical Review 4: Emeigng State-level 
Themes: Strengths and Stressors in 
Educational Accountability Reform, 
p rcvides valuable insight into state- 
level perspectives on the evolving 
nature of accountability re formas it 
relates to students. The qualitative 
data, collected October 2001 to May 
2002, reflect the perspectives of state- 
level personnel who were involved 
with the creation and implementation 
of their state accountability systems. 
About one third of these interviews 



took place before NCLBA was signed 
into law, but participant comments 
reveal their awareness and concerns 
over the pending legislation. 

Highlights 

The debate about the inclusion of 
students with disabilities in perform- 
ance-based accountability systems 
remains ongoing, but a key finding of 
this study was that most participants 
wholeheartedly supported this policy 
d i redion. Participants provided evi- 
dence from state assessments that 
challenged the assumptions that stu- 
dents with disabilities would perf o mn 
badly on state assessments and be 
unable to reach grade level. However, 
most participants commented that, at 
all levels of the educational system, 
some individuals still thought that most 
students with disabilities should not 
participate in state assessments. 

A key issue throughout these inter- 
views was the recommendation that 
special education and general educa- 
tion personnel at all levels of the sys- 
tem need to increase their level of col- 
laboration and work together on an 
on-going basis to ensure that students 
with disabilities are integrated into all 
reform efforts. State-level patici pants 
commented that the new requirements 
of the NCLBA would encourage 
g reater collaboration and viewed this 
positively as a way of ensuring that 
the needs of students with disabilities 
would be integrated into the design 
and implementation of the reform 



efforts rather than addressed as an 
afterthought. 

Participants emphasized the impor- 
tance of developing teacher and 
administrator capacity to effectively 
implement curricula at the school 
level, use data effectively and realize 
the full potential of the accountability 
reform. Participants were concerned 
that without appropriate pofessional 
development for teachers and admin- 
istrators at the school level effective 
alignment of standards-based curricu- 
lum and instructional materials 
designed to meet the unique needs of 
diverse learners would not take place. 
The role of the principal as instruction- 
al leader of the school emerged as a 
c rucial element to the success of 
accountability reform 

Participants in each of the states 
raised a number of technical concerns 
relating to the development and 
administration of state assessments 
and the state's capacity to track and 
report student enrollments and per- 
f o rmance data. Participants also 
expressed concern about the validity, 
reliability, and construct- reliance of 
the alternate assessment compared to 
the general state assessment. 
Additional information gathered from 
state-level representatives on the 
evolving nature of accountability 
nefomnas it relates to students with 
disabilities is available at 
www.eprri.org. 
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Highly qualified 
Teachers for Students 
with Disabilities: 
Identifying the 
Knowledge and Skills 
Needed by Special 
Educators 



Topical Review 5, Preparing Educators 
to Teach Students with Disabilities in 
an Era of Standards- Based Reform 
and Accountability, provides an 
insight into how state and national 
policy and standards based practices 
a re supporting the introduction of 
high quality teacher preparation pro- 
grams. Information regardng these 
policies and standards was collected 
th rough journals, literature reviews, 
and resea rch via the internet. 

NCLBA requires states and districts 
to have a highly qualified teacher in 
every classroom by 2005-06. As a 
result, there has been a call for high 
quality teacher preparation and train- 
ing programs that also align their 
p rograms with the content and 



achievement standards established by 
individual states. Although this call 
comes at a time of severe teacher 
shortage in school districts across 
America, NCLBA places the focus on 
improving teacher quality because it is 
more closely related to student 
achievement than any other factor 
(i.e. class size, spending, and instruc- 
tional materials). 

In order for teachers to effectively 
p romote the achievement of students 
with disabilities, both special educa- 
tors and general educators need a 
repertoireof skills. These include a 
working knowledge of state and fed- 
eral requi reients for the patici po- 
tion, content standards, and achieve- 
ment standards, how to individualize 
instrudion for students receiving spe- 
cial education services, and how to 
include students with disabilities in the 
general assessments. It is the respon- 
sibility of the teacher to ensure that 
the accommodations and modifica- 
tions being made are in the best inter- 
est of the student. If a student is not 
eligible to participate in the general 
assessment, teachers must receive 
training in the administration of the 
alternate assessment specified by 
their state. 




Standards-based reform has 
p rompted many states to undergo 
substantial changes in teacher prepa- 
ration programs and state licensure 
requirements. This includes determ i n- 
ing rigorous standards that focus on 
the knowledge and skills needed by 
entry-level teachers across various dis- 
ciplines, competency- or performance- 
based req u i rerents for teacher licen- 
sure, and providing structured intern- 
ship opportunities. One difficulty 
states now face with licensure tests is 
their infrequent alignment with the 
emerging academic content required 
for states. 

Because the need for teachers has 
become so great, particularly in the 
a rea of special education, many states 
allow teachers to become certified 
th rough an alternate certification 
p rocess, in order to expedite the 
p rocess of licensure. These programs 
generally assume that if a prospective 
teacher has subject-area knowledge, 
the student teaching and education 
coursework can be condensed into a 
very short time period. 

More information regardng the 
requirements for and the training of 
highly qualified teachers is available 
at www.eprri.org. 
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Parent Perspectives: 
Reporting the 
Performance and 
Achievements of 
Students with 
Disabilities 

At EPRRI's sixth Policy Symposium of 
February 3-4, 2003, we sought input 
f rom parents of students with disabili- 
ties regarding usability of current 
reporting formats and procedures, 
specific indicators of school perf o rm- 
ance that parents would like to see 
reported, and the accessibility of 
re port cards. Each of EPRRI's four 
study states of California, Maryland, 
New York, and Texas were represent- 
ed through parent participation. In 
addition, representatives from parent 
advocacy groups and the U.S. 
Department of Education, Office of 
Special Education Programs attended. 

Highlights 

Some parents said they did not 
know about the assessment require 
ments under NCLBA as they relate to 
children with disabilities. Assessments 
for evaluation purposes were familiar, 
but those for academic performance 
we re not. The language of accounta- 
bility and emphasizing the state's role 
in their child's education were both 
new elements for parents. 

Many parents felt that their districts 
weneeither unable or unwilling to 
p rovide them with assessment infor- 
mation re g arcing the content and 





strectureof assessment(s). Concerns 
were also expressed over children in 
separate settings, their opportunity to 
I earn the material tested on state 
assessments, and the possible lack of 
individualized instruction. Several par- 
ents said they believed that assessment 
data would be useful in IEP meetings 
as a way to get districts to focus on 
programs and results. However, many 
were also concerned that students with 
disabilities might be blamed if they 
were perceived to be the cause of a 
school receiving sanctions. 

A parent-designed school report 
card for elementary, middle, and high 
schools would contain the following 
features 

• More information about the school 
itself included in the re port cards, 
such as demographics compared 
within and across districts, a mission 
statement, and participation rate 
disaggregcfed by disability, 

• Placement of students with disabili- 
ties in Least Restrictive Environments 
(LRE) by key academic subjects, 
gender, and disability category, 



• Students in alternate settings, such 
as the juvenile justice system, coun- 
ty-based programs, interim alternate 
educational settings, etc., 

• Teacher qualifications for regular 
and special education teachers, 
paraprofessionals, and service 
providers, 

• P rofessional development opportu n i- 
ties and amount of time spent by 
teachers in professional develop- 
ment activities. 

Issue Brief 6: 
Opportunities and 
Challenges: 
Perspectives on 
NCLBA from Special 
Education Directors 
in Urban School 
Districts 

This Issue Brief presents the views of 
eleven individuals, all in special edu- 
cation leadership positions in selected 
urban school districts, concerning the 
opportunities and challenges their dis- 
tricts face in implementing key NCLBA 
neq u i ranents for students with disabili- 
ties. Results from a survey and two 
focus groups, conducted in July 
2003, reveal that although district 
leaders see opportunities for students 
with disabilities, many are facing sig- 
nificant challenges. These challenges 
are similar across districts despite dif- 
f e rences in geographic location, 
district size, 
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and student characteristics. Some spe- 
cific issues relate to multiple themes, 
thus highlighting the complex nature of 
many topics within the field of educa- 
tion, particularly special education. 

Issues include: 

• Participation and perf o rmcnce of stu- 
dents with disabilities on state assess- 
ments- According to our respondents, 
although districts ranged widely in 
their success in making Adequate 
Yearly Progress (AYP) in 2002-03 for 
all students, in most districts no 
schools made AYP for students with 
disabilities. The possibility of sanc- 
tions encourages teachers and admin- 
istrators to utilize various strategies to 
solve this problem, including placing 
low performing students with disabili- 
ties on the state's alternate assessment 
and referring struggling students to 
special education. District strategies 
include implementing extended school 
year programs and summer school. 
Some participants were cautiously 
optimistic that special education identi- 
fication rates may decrease over time. 



• Personnel- Many district special edu- 
cation leaders are struggling with the 
new requirement that all core aca- 
demic subjects be taught by highly 
qualified teachers by 2005-06. 
Several participants expressed doubts 
that alternate certification programs 
we re the answer to the problem. The 
d i fficulties in retaining and training 
principals in an atmosphere of high- 
stakes and strict accountability were 
also discussed. 

• Finance and resources- The combina- 
tion of the new federal mandates and 
budget deficits was of paramount 
concern to all participants. Some 
spoke of concerns with program cuts, 
increased refenal rates due to a lack 
of targeted or remedial regular edu- 
cation programs, and inability to hire 
new teachers or to retain existing 
ones. Adequate funding was an area 
that all participating district special 
education leaders deemed critical to 
the success of NCLBA legislation. 

• Alignment of IDEA and NCLBA - 
Some district leaders pointed out the 
d i fficuliy in aligning NCLBA with the 
req u i rmrents of IDEA and the philoso 



phy guiding special education prac- 
tice. Specifically, they discussed a 
trend away from inclusion, regarded 
test-based accountability as being a 
th reatto advances in providing least 
restrictive environment to students 
with disabilities, and feared a return 
to more restrictive placements. The 
logistical challenges involved with 
providing school choice transfers for 
students with disabilities, paticularly 
for those in low incidence programs, 
were proving difficult to navigate for 
some districts. 

• Longevity of reformand timely access 
to policy guidance. An additional 
challenge relates to the perception of 
some participants, particularly those 
f rom states with little experience of 
test-based accountability systems, that 
therewas a lack of clear and consis- 
tent guidance at the federal and state 
level in how to implement some of the 
requirenents of NCLBA. Results from 
this study reveal a lack of understand- 
ing on the part of district leaders con- 
cerning particular provisions of 
NCLBA. In addition, participants 
questioned whether this new initiative 
would last, or be quickly discarded. 
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How Did They Do? A Review of 2002-03 Annual Yearly Progress 
(AYP) in EPRRI’s Participating Study Sites 

EPRRI staff examined adequate California, Maryland, New York, and 

yearly progress results in mathematics Texas. The results are presented in 
and English language Arts/reading Table 1 and 2. AYP status is discussed 
in the four core study states of in this section and more specific 



Table 1 : NCLBA Participation and Performance Results 2002-03, in California, 
Maryland and Texas 



2002-2003 AYP 
Results 


Participation 
Rate ELA 


Performance 

ELA 


Participation Rate 
Mathematics 


Performance 

Mathematics 


CALIFORNIA: 
All Students 


YES 


YES 


YES 


YES 


Special Education 


YES 


YES 


NO 


YES 


District A 
All Students 


YES 


YES 


YES 


YES 


Special Education 


YES 


YES 


YES 


YES 


District B 
All Students 


YES 


YES 


YES 


YES 


Special Education 


YES 


YES 


YES 


YES 


MARYLAND: 
All Students 


YES 


YES 


YES 


YES 


Special Education 


YES 


NO 


YES 


NO 


District C 
All Students 


YES 


YES 


YES 


YES 


Special Education 


YES 


NO 


YES 


YES 


District D 
All Students 


YES 


YES 


YES 


YES 


Special Education 


YES 


NO 


YES 


NO 


TEXAS 
All Students 


YES* 


YES 


YES* 


YES 


Special Education 


YES* 


YES 


YES* 


YES 


District E 
All Students 


YES* 


YES 


YES* 


YES 


Special Education 


YES* 


YES 


YES* 


YES 


District F 
All Students 


YES* 


YES 


YES* 


YES 


Special Education 


YES* 


YES 


YES* 


YES 



* Met participation rate through application of hold harmless. 
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informdion on participating states 
and districts can be found at 
www.eprri.oig 



California 

Adequate Yearly Progress in 
English/language arts (ELA) and 
mathematics is measured by the 
California Standards Test (CST) in 
grades 2-8 and by the California 
High School Exit Examination (CAH- 
SEE) for the secondary grades. 

The state of California did not meet 
the 95% participation req u i rermts for 
the students with disabilities subgroup 
in mathematics on the state assess- 
ments. Participation at the state level 
for students with disabilities in mathe- 
matics was 94.2 percent. The state 
made AYP perf o rmcnce targets for 
both ELA and mathematics for all stu- 
dents and students with disabilities 
s u b g roups. However the proficiency 
rate for students with disabilities in 
both subjects was well below that of 
all students. Both participating study 
districts met the AYP participation and 
p e rf o rmanae re q u i rmrents of NCLBA 
for the 2002-2003 school year for all 
students and students with disabilities, 
however proficiency rates for students 
with disabilities were well below those 
of all students. 



Maryland 

Adequate yearly progress in read- 
ing is measured by the Maryland 
School Assessment (MSA) in grades 
3, 5, and grade 10 reading. In math- 
ematics it is measured by MSA grades 
3 and 5 and grade 1 0 geometry end 
of course assessment. Confidence 
intervals are used when calculating 
minimum requirmrents to ensure 
statistical reliability in determining 
whether AYP is met. The fewer stu- 
dents within a given subgroup, the 
larger the confidence interval; thus, 
the disaggregated subgroups scores 
may fall within wide scoring bands. 
The state and particpating districts 
meet the 95% participation rate. 

At the state and participating district 
level the all students categories were 
well above the AYP proficiency target 
in reading and mathematics. 

However, neither the state nor the 2 
participating districts met AYP targets 
in reading for students with disabili- 
ties. Subsequent to the release of AYP 
results it was re p o rled that score s 
were invalidated for third grade spe- 
cial education students and children 



with limited English proficiency who 
had the accommodation of a verbatim 
reading of the reading assessment. 

The obtained score was substituted 
with the lowest possible score for each 
student in the calculation of AYP. In 
District C this change affected 832 
students and thousands more were 
affected statewide. In District C special 
education students met the state's AYP 
target in mathematics, but the state 
and District D did not. 
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Texas 

Texas used results from the 2001 -02 
Texas Assessment of Academic Skills 
(TAAS) to establish baseline scores for 
2002-03 and converted them to 
reflect estimated standards on the new 
assessment, Texas Assessment of 
Knowledge and Skills (TAKS). 

In Texas the state developed alter- 
nate assessment (SDAA) is designed 
to accommodate more students with 
disabilities than in many other states. 
For 2003, students tested on the 
SDAA, the locally developed alternate 
assessments (LDAA), and the Reading 
P roficiency test in English (RPTE) could 
not be counted as participants in the 
calculation of AYP participation rate, 
which was based on the number of 
students participating on the TAKS. 

The result was that the state and many 
districts did not meet NCLBA parti c i- 
patiion req u i rements. 

Additional analyses were conducted 
by the state to identify those districts 
not meeting the AYP participation cri- 
teria solely due to not counting of 
SDAA, LDAA and limited English pro- 
ficient students who were assessed 
only on the state's RPTE. For these dis- 
tricts and campuses, the paticipation 
criteria was reevaluated to include 
special education students tested on 
SDAA or LDAA, and LEP students test- 
ed only on RPTE as participants. 

The state called this "hold hornless" 
the state and our two paticipating 
school districts met AYP participation 
req ui rements. 



The state made AYP performance 
ta rgets for both reading and mathe- 
matics for all students and students 
with disabilities. Both paticipating 
study districts met the AYP perf o rm 
ance req u i rements in mathematics 
and reading for all students and stu- 
dents with disabilities. 

New York 

Adequate yearly progress in read- 
ing and mathematics is based on 
Grade 4 and 8 English language arts 
(ELA) and mathematics assessments 
and high school language arts and 
mathematics Regents Examinations 
(See Table 2 on the next page). 

As of June 2004 the state level 
report is still unavailable. In District G 
all students met AYP performance and 
participation targets for 2002-03 in 
ELA and mathematics. In addition the 
students with disabilities subgroup in 
District G met participation require- 
ments in mathematics and ELA and 
met all perf o rmcrice targets, except 
for middle level ELA. 

District H made AYP for all students 
in mathematics and ELA at the ele- 
mentary school level, but did not 
make AYP for students with disabilities 
in either subject at the elementary 
level. At the middle school and high 
school level neither all students nor 
students with disabilities met NCLBA 
AYP participation requirenents. At the 
middle school level District H made 
AYP for perf o rmance in ELA and 
mathematics for all students and stu- 



dents with disabilities through apply- 
ing New York State's interpertation of 
NCLBA safe harbor provision. Under 
safe harbor the public school or LEA 
may be considered to have made AYP, 
if the percentage of students in that 
group who did not meet or exceed the 
proficient level of academic achieve- 
ment on the State assessments for that 
year decreased by 1 Opercent of that 
percentage from the preceding public 
school year, that group made 
progress on one or more of the State's 
academic indicators, and that group 
had at least 95 percent participation 
rate on the statewide assessment. As 
noted above, however, the middle 
level participation rate did not meet 
NCLBA's 95 percent requirement. At 
the high school level however, the dis- 
trict did not meet safe harbor perf o rm- 
ance requirements in either subject for 
all students or students with disabilities. 
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How Did They Do? A Review of 2002-03 Annual Yearly Progress 
(AYP) in EPRRI’s Participating Study Sites 



Table 2: New York Participating District AYP Results in ELA and Mathematics 2002-03 



AYP COMPONENT 


DISTRICT G 




DISTRICT H 




All Students Special Education 


All Students 


Special Education 


ELA Grade 4 










Participation 


YES 


YES 


YES 


YES 


Performance 


YES 


YES 


YES 


NO 


ELA Grade 8 










Participation 


YES 


YES 


No 


No 


Performance 


YES 


NO 


YES* 


YES* 


ELA High School 










Participation 


YES 


— 


— 


— 


Performance 


YES 


YES 


NO 


NO 


Mathematics: Grades 4 










Participation 


YES 


YES 


YES 


YES 


Performance 


YES 


YES 


YES 


NO 


Mathematics: Grade 8 










Participation 


YES 


YES 


No 


No 


Perfo rmcnce 


YES 


YES 


YES* 


YES* 


Mathematics: High School 










Participation 


— 


— 


— 


— 


Performance 


YES 


YES 


NO 


NO 


— Not available from current district report cards 
* Met AYP target through NYS interpretation of the safe harbor povision. 
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Overall Impressions 

Generally, EPRRI's study sites suc- 
cessfully met many of the 2002-03 
AYP targets. Meeting the NCLBA par- 
ticipation requirement was challenging 
in Texas at the district and state level 
and this situation remains unresolved. 
In California, the paticipation 
req u i rement was an issue at the state 
level, but not for the two participating 
districts. District H also had problems 
meeting NCLBA participation require 
ments at the middle school level. In 
March 2004, the U.S. Department of 
Education announced new policies for 
calculating participation rates, allow- 
ing states to average paticipation 
rates over a three-year period. In 
addition, students who are unable to 
take the test during the testing and 
make-up windows because of a 
unique, significant medical emergency 
will not count against the school's par- 
ticipation rate. 



In terms of performance, the 
students with disabilities subgroup met 
AYP targets in most study sites, 
although performance was generally 
well below that of all students. The 
only serious exception to this occurred 
in District H; however it is important to 
point out that this district faces a num- 
ber of unique challenges. The impact 
of non-standard accommodations on 
the reading scores of students with 
disabilities was an issue in Maryland, 
but did not appear to have an impact 
in other states. 

EPRRI states, along with other states 
and districts across the country face 
additional challenges in the coming 
years. For those states that do not 
already include them testing for 
grades 3 through 5 will be added to 
AYP calculations beginning in 2005- 
06 and AYP targets will likely increase 
in many states because of the require 
ment that the first increase from base- 
line AYP occur within 2 years of the 



implementation of the law. In addition 
the policy context in EPRRI's study 
states remains fluid as Maryland, 

New York, and Texas have proposed 
changes to their initial Title 1 
Consolidated State Application 
Accountability Workbooks, several of 
which relate directly to the students 
with disabilities subgroup. Any pro- 
posed changes must be submitted to 
and approved by the US Department 
of Education. Meanwhile, California is 
one of 1 6 states who are support i n g 
changes in the law to allow states the 
option of using a growth model and 
not the current status model in deter- 
mining yearly progress. 
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EPRRI's Core Study States 

We conduct research in collabora- 
tion with four states and eight local 
school districts: 

CALIFORNIA 

• Long Beach Unified School 
District 

• New Haven Unified School 
District 

MARYLAND 

• Carroll County Public Schools 

• Montgomery County 
Public Schools 

NEW YORK 

• North Colonie Central 
School District 

• Rochester City School District 
TEXAS 

• Cypress-Fairbanks Independent 
School Distrcit 

• Garland Independent 
School District 
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For More on These 
Policy Update Topics • •• 

Visit our website www.eprri.org 



Who is involved 

EPRRI is a project of the Institute for 
the Study of Exceptional Children and 
Youth at the University of Maryland, in 
collaboration with the National Center 
on Educational Outcomes and the 
Urban Special Education 
Leadership Collaborative. 

EPRRI is funded by the U.S. 

Depa rlment of Education's Office of 
Special Education Programs. 

The Institute for the Study of 
Exceptional Children 
and Youth 
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